Association of a longitudinal, preclinical ultrasound curriculum with medical student performance.

INTRODUCTION: Point-of-care ultrasound (US) is used in clinical practice across many specialties. Ultrasound (US) curricula for medical students are increasingly common. Optimal timing, structure, and effect of ultrasound education during medical school remains poorly understood. This study aims to retrospectively determine the association between participation in a preclinical, longitudinal US curriculum and medical student academic performance. METHODS: All first-year medical students at a medical school in the Midwest region of the United States were offered a voluntary longitudinal US curriculum. Participants were selected by random lottery. The curriculum consisted of five three-hour hands on-sessions with matching asynchronous content covering anatomy and pathologic findings. Content was paired with organ system blocks in the standard first year curriculum at our medical school. Exam scores between the participating and non-participating students were compared to evaluate the objective impact of US education on performance in an existing curriculum. We hypothesized that there would be an association between participation in the curriculum and improved medical student performance. Secondary outcomes included shelf exam scores for the surgery, internal medicine, neurology clerkships and USMLE Step 1. A multivariable linear regression model was used to evaluate the association of US curriculum participation with student performance. Scores were adjusted for age, gender, MCAT percentile, and science or engineering degree. RESULTS: 76 of 178 students applied to participate in the curriculum, of which 51 were accepted. US curriculum students were compared to non-participating students (n = 127) from the same class. The US curriculum students performed better in cardiovascular anatomy (mean score 92.1 vs. 88.7, p = 0.048 after adjustment for multiple comparisons). There were no significant differences in cumulative cardiovascular exam scores, or in anatomy and cumulative exam scores for the gastroenterology and neurology blocks. The effect of US curriculum participation on cardiovascular anatomy scores was estimated to be an improvement of 3.48 points (95% CI 0.78-6.18). No significant differences were observed for USMLE Step 1 or clerkship shelf exams. There were no significant differences in either preclinical, clerkship or Step 1 score for the 25 students who applied and were not accepted and the 102 who did not apply. CONCLUSIONS: Participation in a preclinical longitudinal US curriculum was associated with improved exam performance in cardiovascular anatomy but not examination of other cardiovascular system concepts. Neither anatomy or comprehensive exam scores for neurology and gastrointestinal organ system blocks were improved.

Strategies for identifying students at risk for USMLE step 1 failure.

BACKGROUND AND OBJECTIVES: Failing Step 1 of the US Medical Licensing Examination (USMLE) or a delay in taking the exam can negatively affect a medical student's ability to match into a residency program. Unfortunately, identifying students at risk for failing Step 1 is challenging, but it is necessary to provide proactive educational support. The purpose of this study was to develop a strategy to identify students at risk for failing Step 1. METHODS: Using a retrospective study design, 256 students from the class of 2008 were eligible for the study. Independent variables included Medical College Admission Test (MCAT) scores and cumulative grades from years 1--2 of medical school. The dependent variable was their score on the USMLE Step 1. Variables with a significant univariate relationship were loaded into a series of binary logistic regression models. A receiver operating characteristic (ROC) curve examined the significant variables. RESULTS: Both year-2 standard score and the MCAT biological sciences score were significant as predictors of failure. The ROC curve provided a range of values for establishing a cutoff value for each significant variable. CONCLUSION: Using internal and external predictors, it is possible to identify students at risk for failing Step 1 of the USMLE.

Incorporating Geographic Information Systems (GIS) into program evaluation: lessons from a rural medicine initiative.

PURPOSE: To address the shortage of physicians practicing in rural areas of Michigan, the Wayne State University School of Medicine developed an integrated rural core curriculum to interest students in rural practice careers. Here we focus on the evaluation strategy used to determine the extent to which students in the new rural medicine interest group who self-identified as selecting a rural clerkship or externship did secure a clinical training experience in a rural setting. METHODS: Three measures of rurality were compared to determine whether students were placed in rural training settings: (1) the percentage of the county living in rural areas; (2) a county-level dichotomous measure of rural/nonrural; and (3) a dichotomous measure based on urban area boundaries within the county. Practice address and geographic data were integrated into geographic information systems software, which we used to map out rural characteristics of Michigan counties through a process called thematic mapping; this shows characteristic variation by color-shading geographic features. In addition, reference maps were created showing the boundaries of urban areas and metropolitan/micropolitan areas. Once these processes were completed, we overlaid the practice location on the contextual-level geographic features to produce a visual representation of the relationship between student placement and rural areas throughout the state. RESULTS: The outcome of student placement in rural practices varied by the definition of rural. We concluded that, although students were not placed in the most rural areas of Michigan, they received clerkship or externship training near rural areas or in semirural areas. CONCLUSION: This process evaluation had a direct impact on program management by highlighting gaps in preceptor recruitment. A greater effort is being made to recruit physicians for more rural areas of the state rather than urban and semirural areas. Geographic information systems mapping also defined levels of ruralism for students to help them make informed selections of training sties. This is especially important for students who are not sure about a rural experience and might be discouraged by placement in a remote rural area.

Qualitative and quantitative outcomes of audience response systems as an educational tool in a plastic surgery residency program.

BACKGROUND: In-training evaluations in graduate medical education have typically been challenging. Although the majority of standardized examination delivery methods have become computer-based, in-training examinations generally remain pencil-paper-based, if they are performed at all. Audience response systems present a novel way to stimulate and evaluate the resident-learner. The purpose of this study was to assess the outcomes of audience response systems testing as compared with traditional testing in a plastic surgery residency program. METHODS: A prospective 1-year pilot study of 10 plastic surgery residents was performed using audience response systems-delivered testing for the first half of the academic year and traditional pencil-paper testing for the second half. Examination content was based on monthly "Core Quest" curriculum conferences. Quantitative outcome measures included comparison of pretest and posttest and cumulative test scores of both formats. Qualitative outcomes from the individual participants were obtained by questionnaire. RESULTS: When using the audience response systems format, pretest and posttest mean scores were 67.5 and 82.5 percent, respectively; using traditional pencil-paper format, scores were 56.5 percent and 79.5 percent. A comparison of the cumulative mean audience response systems score (85.0 percent) and traditional pencil-paper score (75.0 percent) revealed statistically significantly higher scores with audience response systems (p = 0.01). Qualitative outcomes revealed increased conference enthusiasm, greater enjoyment of testing, and no user difficulties with the audience response systems technology. CONCLUSIONS: The audience response systems modality of in-training evaluation captures participant interest and reinforces material more effectively than traditional pencil-paper testing does. The advantages include a more interactive learning environment, stimulation of class participation, immediate feedback to residents, and immediate tabulation of results for the educator. Disadvantages include start-up costs and lead-time preparation.

Retention of medical genetics knowledge and skills by medical students.

PURPOSE: To determine whether specific knowledge and skills medical students acquire after completing a Year 1 genetics course are retained at the end of Year 3. METHODS: A genetics case was developed for an observed structured clinical exam at the end of Year 3. The case involved a pregnant patient who underwent population screening for cystic fibrosis and is identified as a carrier of a common mutation. Student's performance in completing eight essential genetic tasks taught in Year 1 was assessed by their ability to apply these concepts in the Year 3 observed structured clinical exam. RESULTS: A total of 212 students were included in the study. Performance on the essential tasks revealed that students were better able to discuss inheritance pattern (73.1%). Students were less likely to calculate and discuss fetal risk (25%), discuss the option of prenatal diagnosis if the father is a carrier (25%), and ask about a family history of cystic fibrosis (36.8%). Only half (50%) explained the test result and implications to the patient. There was no correlation between individual student exam scores in Year 1 and the eight essential genetics tasks scores assessed in the observed structured clinical exam (r = 0.003, P < or = 0.67). CONCLUSION: Third year medical students do not retain medical genetics knowledge and skills learned in the first year of medical school. Medical schools need to integrate genetics curriculum through the continuum of the 4 years of medical school.

The effectiveness of streaming video on medical student learning: a case study.

Information technology helps meet today's medical students' needs by providing multiple curriculum delivery methods. Video streaming is an e-learning technology that uses the Internet to deliver curriculum while giving the student control of the content's delivery. There have been few studies conducted on the effectiveness of streaming video in medical schools. A 5-year retrospective study was conducted using three groups of students (n = 1736) to determine if the availability of streaming video in Years 1-2 of the basic science curriculum affected overall Step 1 scores for first-time test-takers. The results demonstrated a positive effect on program outcomes as streaming video became more readily available to students. Based on these findings, streaming video technology seems to be a viable tool to complement in-class delivery methods, to accommodate the needs of medical students, and to provide options for meeting the challenges of delivering the undergraduate medical curriculum. Further studies need to be conducted to continue validating the effectiveness of streaming video technology.

Evaluating the phobias, attitudes, and cultural competence of Master of Social Work students toward the LGBT populations.

BACKGROUND: Evidence suggests there is bias toward lesbian, gay, bisexual, and transgender (LGBT) persons by social workers; unfortunately, little research has been conducted to examine Master of Social Work (MSW) students' views toward these populations. The purpose of this study was to develop an assessment scale to evaluate the attitudes, phobias, and cultural competence of MSW students toward the LGBT populations. METHODS: An assessment scale was developed and administered to MSW students (n = 173) at a Midwestern American university. RESULTS: The majority of MSW students reported low phobia and a positive attitude toward the LGBT populations, yet participants reported having a low level of cultural competence in serving LGBT clients. CONCLUSION: More education and training is needed for MSW students to effectively serve the LGBT populations.

Wireless Handheld Computers in the Undergraduate Medical Curriculum.

Wayne State University Medical School has implemented wireless handheld computers or PocketPCs (PPCs) into all four years of the undergraduate curriculum. A transition from a passive to an interactive learning environment in the classroom, as well as administrative solutions for monitoring patient encounter data by students in their clinical rotations was fostered by this educational technology. Implementation of the wireless devices into the curriculum will be described in this report. This will include the technical specifications and justification for the required device, as well as a detailed discussion of the different applications used for educational and administrative purposes by the preclinical and clinical students. Outcomes from the educational and administrative aspects of the project will also be presented in this report.

Promoting informed decision making: evaluating a community-based prostate health awareness program.

BACKGROUND: For health educators, the controversy surrounding routine prostate cancer screening provides curriculum development and delivery challenges. The purpose of this study was to evaluate a community-based prostate health awareness program. METHODS: Using a pretest-posttest design, participants were recruited from community-based organizations to assess the effectiveness of the program in the areas of knowledge gain, short-term intentions, and changing prostate health behaviors. RESULTS: Many of the participants reported having been tested for prostate cancer, yet there was a lower than expected pretest knowledge base. There were significant increases in knowledge on the posttest and some impact on short-term intentions and behavior. DISCUSSION: A community-based prostate health awareness program prior to the patient-physician encounter can assist health-care professionals in the education process and give men the tools to make an informed decision.

Measurement practices: methods for developing content-valid student examinations.

Measurement experts generally agree that a systematic approach to test construction will probably result in an instrument with sound psychometric properties. One fundamental method is called the blueprint approach to test construction. A test blueprint is a tool used in the process for generating content-valid exams by linking the subject matter delivered during instruction and the items appearing on the test. Unfortunately, this procedure as well as other educational measurement practices is often overlooked A survey of curriculum administrators at 144 United States and international medical schools was conducted to assess the importance and prevalence of test blueprinting in their school. Although most found test blueprinting to be very important, few require the practice. The purpose of this paper is to review the fundamental principals associated with achieving a high level of content validity when developing tests for students. The short-term efforts necessary to develop and integrate measurement theory into practice will lead to long-term gains for students, faculty and academic institutions.

Evaluation of a preparatory community-based prostate health education program.

BACKGROUND: Medical organizations are divided on the issue of screening for prostate cancer, yet there is agreement that men should be educated about prostate health. Shared decision making involves patients and practitioners in this process, yet some men need preparatory education prior to the physician encounter. This study assessed the effectiveness of a community prostate health awareness program, focusing on men at risk for prostate cancer. METHODS: Participants were given a pretest and a posttest to assess knowledge gains and impact on short-term intentions to address their prostate health. RESULTS: There was a statistically significant increase in knowledge. Short-term intentions increased for those participants meeting the inclusion criteria. DISCUSSION: Community outreach programs remain an excellent vehicle to educate the public and complement the efforts of health care providers.

An Integrated Approach for Evaluating Students' Achievement of Clinical Objectives.

During the clinical phase of undergraduate medical education (UME) students are often geographically dispersed and assigned to preceptors throughout the community. Monitoring, documenting, and evaluating their clinical experiences and achievement of clinical objectives in this venue becomes a challenge, especially for large UME programs. The purpose of this manuscript is to discuss a method for developing and implementing a school-wide evaluation system for the clinical phase of UME. This type of evaluation system links students' clinical experiential data with the objectives of a clerkship, using technological advances, such as the Personal Digital Assistant (PDA), Internet, and intranet. Clerkship directors are provided realtime reports on student's progress toward achieving clerkship objectives and are able to monitor the clinical activities of the clerkship. Students on the other hand, will be empowered to take more control of their educational experiences by monitoring their own progress.